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REMARKS 



Status of the Claims 

Claims 1-44 remain pending in the present application, Claims 1, 12, 20 and 31 having been 
amended to more clearly define the recited subject matter. New claims 42-44 having been added. 
Support for these new claims is found in the specification on page 15, lines 19-page 16, line 2. 
Rejection of Dependent Claim 41 

The Examiner has rejected Claim 41 under 35 U.SC. § 112, second paragraph, as being 

indefinite for failing to particularly point out and distinctly claim the subject matter which applicants 

regard as the invention. Claim 41 is reproduced below: 

The system of Claim 20, further comprising a beam splitter, said beam splitter 
reflecting light from one of the image source and a real world scene, so that the 
viewer can simultaneously view the real world scene and the image provided by the 
image source. 

As highlighted by the italicized portion in the above quote, the Examiner has indicated that 
the recitation of a "beam splitter reflecting light from one of the image source and a real world scene, 
so that the viewer can simultaneously view the real world scene and the image provided by the image 
source" is vague and indefinite, in that it is unclear how the viewer can simultaneously view both 
images, "e.g. the real world scene and the image provided by the image source," when the beam 
splitter is reflecting light from only one of the image source, "e.g. either the real world scene or the 
image provided by the image source." The Examiner has requested clarification. 

Accordingly, it may be helpful to think of the beam splitter as similar to a plate of glass that is 
approximately 50% transmissive and 50% reflective. For example, it is possible to look out a 
window and view a real world scene yet at the same time it is possible to see your reflection on the 
plate of glass comprising the window. In addition, applicants have provided below an example that 
appears in the specification of the present application to illustrate this claim. FIGURE 5 or in the 
alternative, FIGURE 6 and their accompanying text, disclose how light is reflected from the image 
source such that the viewer can simultaneously view the real world scene and the image provided by 
the image source. 

Applicants' specification states: 

In another embodiment, which is shown in FIGURE 5, both accommodation 
monitoring device 68 and large DOF display 54' are disposed perpendicular to the line 
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of sight of the viewer's eye 62. Beam splitter 66' reflects the non-visible measurement 
signal from accommodation monitoring device 68 into the eye and also reflects the 
measurement signal from the eye back into lens 70 of the accommodation monitoring 
device. Beam splitter 66 (or a cold mirror), which transmits the non-visible 
measurement beam, reflects light from large DOF display 54' into eye 62 , enabling the 
viewer to superimpose the displayed images with real objects 75. (Emphasis added, 
applicants' specification, page 13, lines 1-9). 

As highlighted by the underlined portion quoted above, the beam splitter (for example, the 
cold mirror) both transmits the non-visible measurement beam and reflects light from the large DOF 
display (for example, the image source) into eye 62. In this manner, the viewer can simultaneously 
view the real world scene and the image, because as highlighted in the italicized portion above, the 
displayed images are superimposed with real objects 75. In addition, although not explicitly stated in 
the text, but as evident in FIGURE 5, beam splitter 64 can also reflect light from a real world scene, 
i.e., light from real objects 75. 

Applicants therefore respectfully request that the Examiner withdraw the rejection of 
Claim 41, since support for its recitation is clearly provided in applicants' drawings and the 
specification. 

Claims Rejected Under 35 U.S.C. § 103(a) 

The Examiner has rejected Claims 1, 2, 5-10, 12, 15, 17, 19-21, 24-29, 31, 34, 36, 38, and 41 
under 35 U.S.C. § 103(a) as being unpatentable over U.S. Patent Publication No. 2002/0163482 
(Sullivan) in view of U.S. Patent Publication No. 2003/0086062 (Shevlin). Applicants respectfully 
disagree with the above rejections for at least the following reasons. 

In the interest of reducing the complexity of the issues for the Examiner to consider in this 
response, the following discussion focuses on independent Claims 1 and 20. The patentability of each 
remaining dependent claim is not necessarily separately addressed in detail. However, applicants' 
decision not to discuss the differences between the cited art and each dependent claim should not be 
considered as an admission that applicants concur with the Examiner's conclusion that these dependent 
claims are not patentable over the disclosure in the cited references. Similarly, applicants' decision not 
to discuss differences between the prior art and every claim element, or every comment made by the 
Examiner, should not be considered as an admission that applicants concur with the Examiner's 
interpretation and assertions regarding those claims. Indeed, applicants believe that all of the dependent 
claims patentably distinguish over the references cited. In any event, a specific traverse of the rejection 
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of each dependent claim is not required, since dependent claims are patentable for at least the same 
reasons as the independent claims from which the dependent claims ultimately depend. 
Patentability of Independent Claim 1 

Significant differences exist between the recited subject matter and the cited art, because the 
cited art does not teach or suggest that the image is displayed on a large depth of focus display, as 
recited in step (a) of the claim and does not teach or suggest displaying an image having an apparent 
focus plane that tracks the accommodation of the viewer, based on the accommodation that was 
determined, as recited in step (c) of Claim 1 . Furthermore, the cited art teaches away from using a 
large depth of focus display. 
Discussion of Step (a) in Claim 1 

It is clear that Sullivan is NOT teaching the use of a large depth of focus display, as recited 
by applicants in step (a), but instead, only employs a narrow depth of focus display. The Examiner 
has indicated that Sullivan uses a large depth of focus display, as shown in Sullivan's FIGURE 1 and 
FIGURES 4-7, for displaying an image to a viewer on a large depth of focus display. But each of the 
image planes in FIGURE 1 actually indicate that Sullivan's invention is dependent on use of a narrow 
depth of focus display. In order to assist the Examiner in understanding why Sullivan is teaching a 
narrow depth of focus display, it may be helpful for the Examiner to consider the following remarks. 

It is important to understand that the human eye cannot simultaneously bring distant and 
nearby objects into sharp focus on the retina (analogously, a conventional camera with a larger lens 
opening cannot simultaneously bring into focus near and distant objects). At a given instant in time, 
the eye can only bring objects at one distance into sharp focus, and there is a roll-off in focus for 
objects that are in front of or behind that "sweet spot" of focus — the farther an object is from that 
sweet spot, the more blurred will be its image on the retina. The term "depth of focus" (sometimes 
used interchangeably with the term "depth of field") is used in optics and vision science to describe 
how gradually or suddenly the roll-off in retinal image focus is, as objects are moved away from the 
sweet spot. In photography, the depth of focus of the camera is varied by adjusting the size of the 
aperture (i.e., the /-stop). Decreasing the aperture increases the depth of focus, and "pinhole" 
apertures that are 0.5mm diameter and smaller provide an effectively infinite depth of focus (wherein 
distant and nearby objects are both in focus). In contrast to a camera lens, the human eye has a 
narrow depth of focus under all natural viewing conditions, because its pupil (i.e., its aperture) cannot 
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constrict to a 0.5mm diameter. Thus, conventional video displays, such as LCD screens, are viewed 



with a narrow depth of focus. 

To give the eye a large depth of focus, it is necessary to "artificially" decrease the effective 
pupil diameter by using a display that has a small "exit pupil." As explained in applicants' 
specification: 

Some viewing conditions artificially increase the DOF of the eye. For 
instance, if a scene is viewed through a small pinhole, then both distant and near 
objects are in focus at the same time. Under such conditions, the negative feedback of 
dioptric blur is removed or substantially decreased, and accommodation is said to be 
'open-loop" (because the feedback loop is interrupted). Under open-loop 
accommodation conditions, the viewer can accommodate from extremely near to far 
without a significant change in the retinal image of the scene. Some video displays 
can be made to have a very large DOF. As one example, the virtual retinal display 
(VRD) described in U.S. Patent No. 5,467,104 can have a large DOF, producing an 
open-loop accommodative response in users. Other large DOF displays can be 
fabricated and methods presented in this document are applicable to all possible large 
DOF displays. (See applicants' specifiation, page 2, line 34-page 3, line 10.) 

However, the display in Sullivan is NOT a large depth of focus display, but instead is a 
narrow depth of focus display. Sullivan teaches: 



Using the MVD system 10, the 3D images 34, 56 are generated to provide for natural 
viewing by the viewer 12, that is the 3D images 34, 56 have substantially all of the 
depth cues associated with viewing a real object, which minimizes eye strain and 
allows viewing for extended periods of time without fatigue. (Sullivan, 
paragraph [0172].) 

As highlighted by the bold and italicized portions quoted above from paragraph [0172] of 
Sullivan, Sullivan teaches that the images provide for natural viewing with all of the depth cues 
associated with viewing a real object. Thus, there is no teaching that there is any configuration to 
make Sullivan operate as a large depth of focus display (such as causing the viewer to view the scene 
through a small pinhole). Sullivan does not teach or suggest any such approach. Instead, Sullivan is 
completely configured for natural viewing with all of the depth cues present that are provided by a 
narrow depth of focus display. 

Furthermore, Sullivan recites subject matter in Claims 10 and 11 that indicates that the 
approach used by Sullivan is directed toward a narrow depth of focus display. Notice that Claim 10 
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of Sullivan recites that the multi-surface optical device operates in a normal mode, such that each of 
the plurality of optical elements is in a scattering state. In Claim 11, Sullivan recites that the multi- 
surface device operates in a reverse mode such that each of the plurality of optical elements is in a 
transparent state in the absence of an electric field, and in a scattering state in the presence of an 
electric field. In other words, Sullivan teaches a stack of LCD shutters, each of which takes turns 
acting as a projection screen that scatters light in many directions. Such scattering results in an exit 
pupil larger than the entrance pupil of the viewer's eye, and thus produces a natural narrow depth of 
focus. 

In summary, Sullivan includes a stack of multiple narrow depth of focus displays, placed at a 
number of different fixed focal lengths, which is unlike applicants' large depth of focus display that is 
placed at only one fixed focal length. 

Although the Examiner has not cited Shcvlin as disclosing the recitation of step (a), applicants 
would like to point out why Shevlin, in the alternative, also does not disclose the recitation of step (a) 
in Claim 1 . Shevlin indicates in several places that it is directed toward a narrow depth of focus 
display, i.e., Shevlin indicates that it relies on a large exit pupil. For example, Shevlin indicates in 
paragraph 0054, that the final optical system comprises a conventional low-aberration, wide field-of- 
view eyepiece. This paragraph further explains that "it provides a Newtonian view (where light 
passes through most of the eye's entrance pupil) of the image." Thus, Shevlin effectively teaches the 
use of a narrow depth of focus display that corresponds to a large exit pupil. In contrast, a large 
depth of focus display corresponds to a small exit pupil. Furthermore, Shevlin describes that an 
advantage of his invention is its ability to stimulate accommodation optically through provision of 
sufficient photons at appropriate wavelengths, with appropriate wavefront curvature, and with a 
sufficiently large exit pupil (paragraph [0067], emphasis added). 
Discussion of the Recitation of Step (c ) in Claim 1 

In order to illustrate and clarify the differences between the recited subject matter of step (c) 
and the cited art, it may be helpful to consider a portion of an example set forth in applicants' 
traversal of the Restriction Requirement, which was filed on 05/15/2007. Applicants' FIGURE 8 is a 
flow chart showing the logic employed in the present approach to select and display an image with an 
apparent focus plane that corresponds to a viewer's level of accommodation. The steps of this flow 
chart are described on page 15, line 11, through page 16, line 6. More specifically, notice that step 80 
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explains that when a person views the display, the person's eyes accommodate and converge on an 

element in the large depth of focus (DOF) display. The accommodation of the viewer's eye(s) is 

measured in a step 82. Alternatively, the system measures the vergence (or gaze direction) of the 

viewer's eyes in a step 82' (and can then optionally compute the accommodation power based on the 

vergence) (see applicants' specification, page 15, lines 1 1-14). In a step 98, a new image with a best 

focus plane that corresponds to a viewer's level of accommodation is shown. Thus, an example of 

these steps incorporated in the recitation of step (c) would be: 

displaying an image having an apparent focus plane that tracks the accommodation of 
the viewer (i.e., step 98 (new image with a best focus plane)), so that as the 
accommodation of the viewer watching the large depth of focus display changes (i.e. 
step 80 (a person views a display, and the person's eyes accommodate and converge)), 
the image that is displayed (i.e., a tree and house and driveway in the illustrated 
example in FIGURES 2-7) is changed to more accurately convey depth in the image 
that is displayed, based on the accommodation that was determined. 

In contrast, the image that is displayed in Sullivan is NOT changed to more accurately convey 
depth in the image that is displayed, based on an accommodation that was determined. Instead, 
Sullivan uses hardware to convey the depth effect as illustrated in MOE device 32 that comprises a 
stack of single pixel liquid crystal displays, as taught in paragraph [0068]. 

The Examiner has asserted that Sullivan discloses the recitation of applicants' step (c) in 
Claim 1, because Sullivan teaches that the images on the large depth of focus display 36-42 varies, 
i.e., changes, based on the accommodation of viewer 12 to more accurately convey depth in the 
image that is displayed. In support of this assertion, the Examiner cites FIGURE 1 and 
paragraph 0144 of Sullivan. Applicants respectfully disagree. 

In the Abstract, Sullivan teaches that a substantially haze-free three-dimensional (3D) image 
can be viewed on the multi-surface optical device (i.e., using specific hardware) in order to allow it to 
be viewed from a wide range of viewing angles. But this statement does not mean that the image 
itself is displayed differently on the multi-surface optical device when a user changes an 
accommodation, or in other words, when a user views it from a different viewing angle or at a 
different depth of focus in the image. Applicants have clarified this distinction in the amended 
recitation of step (c) to make it clear that the actual displayed image itself is re-rendered, based on 
measuring the eye 's accommodation. Thus, step (c) has been amended to recite that the image is 
displayed and that this change in the displayed image is based on the accommodation determined for 
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the viewer . Accordingly, the displaying performed by applicants' recited technique is unlike that 
used by Sullivan's 3D display, which uses several surfaces at different depths (i.e., hardware) to 
display the image. In other words, Sullivan teaches that depth can be adjusted by varying the 
geometry of MOE device 32 (see Sullivan, paragraph 0147), including the number and spacing of the 
plurality of optical elements 36-42. 

There is No Suggestion to Modify the Sullivan Reference with the Shevlin Reference 

As apparent from the above discussion, applicants have explained why the combination of 
these references does not teach or suggest all of the recitation of Claim 1 . Applicants also point out 
that it is not obvious to modify the Sullivan reference with the Shevlin reference. With respect to 
independent Claim 1 , the Examiner asserts that Sullivan discloses focusing with respect to a viewer 
who is watching the image on a large depth of focus display, and in support of his assertion, the 
Examiner cites page 13, paragraph 0144 of Sullivan. The Examiner acknowledges that Sullivan is 
silent in regards to the explicit step of determining an accommodation for an eye of the viewer and in 
regards to tracking an accommodation of the viewer. But, the Examiner asserts that Shevlin teaches 
this step and cites to FIGURE 1 and page 2, paragraph [0028], wherein the Examiner indicates that 
Shevlin teaches an eye tracking system for monitoring the look direction and accommodative state of 
a viewer. The Examiner concludes that it would have been obvious to one having ordinary skill in 
the art at the time the invention of the present application was made to modify the display system of 
Sullivan in accordance with the teaching of Shevlin, to use an eye tracking system for monitoring the 
look direction and accommodative state of the viewer, in order to simulate a wide field of view, high 
resolution color scene, with low aberration, and thus to optically stimulate the user's accommodative 
system, as suggested by Shevlin on page 1, paragraph 001 1, lines 6-9. 

First, in an effort to clarify the different terms, large depth of focus and narrow depth of focus, 
applicants respectfully point out that "wide field of view" should not be confused with "large depth 
of focus" because field of view refers to width and height of the image, while depth of focus refers to 
the total distance within a scene at which both near and far objects are in focus. 

Second, the Examiner should note that both references are directed toward a narrow depth of 
focus display. In contrast, the recitation in Claim 1 is directed to a large depth of focus display. 
Thus, applicants submit that both the Sullivan reference and the Shevlin reference teach away from 
the recitation in Claim 1, because they teach away from using a large depth of focus display. 
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Accordingly, Sullivan in view of Shevlin does not teach or suggest all of the recitation of Claim 1, 
and the rejection of Claim 1 as being unpatenable over Sullivan in view of Shevlin should be 
withdrawn. 

Since dependent claims inherently include all of the recitation of the independent claim on 
which they ultimately depend, the rejection of dependent Claims 2, 5-10, 12, 15, 17, and 19 should 
also be withdrawn, for at least the same reasons as noted above in connection with independent 
Claim 1. 

Patentability of Independent Claim 20 

Independent Claim 20 is directed toward a system for more accurately conveying depth in an 
image. The Examiner has rejected Claim 20 for reasons similar to those given for the rejection of 
Claim 1. Subparagraphs (d)(i) through (d)(iii) of Claim 20 are generally similar to the steps of Claim 1, 
subparagraphs (a) through (c). Applicants have amended subparagraph (d)(iii) to recite that the image is 
displayed, based on the accommodation that was determined, and the claim already recites a large depth 
of focus display. Thus, applicants respectfully submit that for the reasons given above in their traversal of 
the rejection of Claim 1, significant differences exist between the recited subject mater and the cited 
art, because the cited art does not teach or suggest displaying an image having an apparent focus 
plane that tracks the accommodation of the viewer, based on the accommodation that was determined 
as recited in subparagraph (d)(iii). In addition, the cited art does not teach or suggest that the image 
is displayed on a large depth of focus display, as recited in subparagraph (d)(i). Furthermore, the 
cited art teaches away from the recited subject matter, since the cited art is directed toward the use of 
a narrow depth of focus display - not a large depth of focus display. 

Accordingly, Sullivan in view of Shevlin does not teach or suggest all of the recitation of 
Claim 20, and the rejection of Claim 20 as being unpatenable over Sullivan in view of Shevlin should 
be withdrawn. 

Since dependent claims inherently include all of the recitation of the independent claim on 
which they ultimately depend, the rejection of dependent Claims 21, 24-29, 31, 34, 36, 38, and 41 
should also be withdrawn, for at least the same reasons as noted above in connection with 
independent Claim 20. 
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Discussion of Patentability of Dependent Claims 

The Examiner has also rejected Claims 3, 16, 18, 22, 35, 37, 39, and 40 under 
35 U.S.C. § 103(a) as being unpatentable over Sullivan in view of Shevlin, and further in view of 
U.S. Patent No. 6,449,309 (Tabata). Additionally, the Examiner has rejected Claims 4, 11, 13, 14, 
23, 30, and 32-33 under 35 U.S.C. § 103(a) as being unpatentable over Sullivan in view of Shevlin, 
and further in view of U.S. Patent No. 6,133,944 (Braun et al.). However, because dependent claims 
are patentable for at least the same reasons as the independent claims from which they depend, the 
rejection of Claims 3, 4, 1 1, 13, 14, 16, 18, 22, 23, 30, 32-33, 35, 37, 39, and 40 should be withdrawn 
for at least the same reasons as the rejection of those independent claims. 

Based upon the preceding Remarks, it should be clear that all claims remaining in the present 
application are patentable over the art cited. This case should thus be passed to issue without further 
delay. In the event that any question remains, the Examiner is asked to telephone applicants' attorney 
at the number listed below. 

Respectfully submitted, 



/sabrina k. macintyre/ 
Sabrina K. Macintyre 
Registration No. 56,912 



SKM/RMA:elm 
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